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Abstract 

We consider a tight-binding model with the nearest neighbour hopping integrals on the honey- 
comb lattice in a magnetic field. Assuming one of the three hopping integrals, which we denote 
t a , can take a different value from the two others, we study quantum phase structures controlled 
by the anisotropy of the honeycomb lattice. For weak and strong t a regions, respectively, the 
Hall conductances are calculated algebraically by using the Diophantine equation. Except for a 
few specific gaps, we completely determine the Hall conductances in these two regions including 
those for subband gaps. In a weak magnetic field, it is found that the weak t a region shows the 
unconventional quantization of the Hall conductance, c X y = -(e 2 /h)(2n + 1), (n = 0, ±1, ±2, • • • ), 
near the half-filling, while the strong t a region shows only the conventional one, a xy = —(e 2 /h)n, 
(n = 0, 1, 2, • • • ). From topological nature of the Hall conductance, the existence of gap closing 
points and quantum phase transitions in the intermediate t a region are concluded. We also study 
numerically the quantum phase structure in detail, and find that even when t a = 1, namely in 
graphene case, the system is in the weak t a phase except when the Fermi energy is located near 
the van Hove singularity or the lower and upper edges of the spectrum. 

PACS numbers: Valid PACS appear here 
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I. INTRODUCTION 



The purpose of this paper is to present some arguments for quantum Hall conductivity 
on the honeycomb lattice. Recently, quantized Hall effect is observed in graphene, and the 
Hall conductivity has been determined to be unconventionally quantized [2|, 

e 2 



a xy = -2(2n + l) 



(1) 



xy • ~' h 

(The factor 2 comes from the spin degrees of freedom.) This unusual quantization is relevant 
when single particle physics dominates the behavior of the system 29|, and it has been 
considered as a consequence of the existence of zero modes in graphene a n a a. In 
graphene, there exist zero modes in the absence of a magnetic field due to the honeycomb 
lattice structure, and the unconventional quantum Hall conductance (CQ) was explained by 
treating these zero modes as Dirac fermions si, 4]. However, it is not trivial whether the 
Dirac fermion argument is true or not, because the Hall conductivity is given by an integral 
over whole Brillouin zone while the Dirac-fermion argument looks only the zero mode near 
the Fermi surface. Actually, it has been known that the logic of quantum Hall conductivity 
using the Dirac fermions is not correct in general [7]. Furthermore, numerical analyses 
for the tight-binding model of graphene have shown that the unconventional quantization 
)ersists up to the van Hove singularity where the Dirac fermion argument is no longer valid 



In this paper, we present an alternative explanation of the unconventional quantization 
by using the tight-binding model on the honeycomb lattice. For the tight-bindingmodel 
on the honeycomb lattice, the energy spectrum in a magnetic field was studied in J9|, and 
some numerical analyses for the Hall conductance have been done previously 
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However no analytical study of the Hall conductance was presented systematically. Here 
we obtain the algebraic expression of the Hall conductances for almost all gaps including 
subband gaps, and explain why the unconventional quantum Hall effect ([I]) persists up to 
the van Hove singularity. 

To obtain the algebraic expression of the Hall conductances, we study effects of anisotropy 
of the hopping parameters on the honeycomb lattice 



as suggested by Aubry- Andre duality 



For the square lattice, 



151 ]. it is known that none of gaps closes when we 



change the ratio of the hopping parameters, t x /t y , and this facilitates the calculation of its 



Hall conductances 



161 ] . For the honeycomb lattice, however, it will be found that gap closing 



points appear since there is no duality. We present here a detailed study of the (topological) 
phase structures induced by the anisotropy of the hopping parameters on the honeycomb 
lattice, and determine its Hall conductances. 

In the following, we describe the quantum Hall effect in terms of the Diophantine equa- 
tion. For later convenience we present a brie: 



derivation of the relation between the Hall 
conductance and the Diophantine equation 17]. First we use the Stfeda formula Q, Q for 
the Hall conductance, 



where p is the electron density and the derivative is to be taken with the Fermi leve 



inside the gap. Then at the same time, the Hall conductance is written as 16|, 120, l21| 



fixed 



e 2 



XI) 



-jt r , (3) 



when the Fermi level is in the r-th gap from the bottom, where t r is guaranteed to be an 
integer given by the Chern number. Combining them, we have 

^ = -t (A) 
OB hT" [V 

The energy gaps are stable under small perturbation and therefore persist under slight 
variation of B. Thus we obtain 

const. e „ 

P = + T-Btr, 5 

v h 

where vq is the area of a unit cell. (Here const. /vq is a constant of integration.) When the 
flux per unit cell is $ = p/q (in units of h/e) where p and q are co-prime integers and q > 0, 
the area of the magnetic Brillouin zone is ((27r) 2 /voq), and the density of electrons in a single 
band is given by (1/voq). Thus, when there are r bands below the Fermi energy, the density 
of electrons is 

T 

P = — (6) 

v q 

Then (jSJ) is rewritten as 

r = const, x q + pt r . (7) 
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In this equation, r, p and t r are integers, thus const, x q must be an integer. However, 
since const, is independent of q and q can change when the magnetic field is varied without 
making a point of contact, then const, itself must be an integer s r . Thus we have 

r = qs r +pt r , (8) 

which is the Diophantine equation. 

The plan of the remainder of the paper is as follows. In SecJTTl we explain the tight-binding 
model on the honeycomb lattice briefly. An anisotropic hopping parameter t a is introduced 
in the tight-binding model. In Sec JIIIl the weak t a limit is studied. It is shown that the Hall 
conductances for almost all gaps including subband ones are determined algebraically by 
using the Diophantine equation. Furthermore, in a weak magnetic field, the unconventional 
Hall effect ([T]) is found to hold for visible gaps. We study the strong t a limit in Sec JIVI In 
this limit, our model on the honeycomb lattice is shown to reduce to a pair of the tight- 
binding models on the square lattice. Using this result, we establish an algebraic rule to 
determine the Hall conductances in the strong t a limit. It is found that the algebraic rule in 
the strong t a limit is different from one in the weak t a limit. As a result, only conventional 
quantization of the Hall conductance is obtained in this limit. From the differences of 
the Hall conductances between the two limits, the existence of the gap closing points and 
topological quantum phase transitions in the intermediate t a region are concluded. In SecJVl 
we study the topological quantum phase transitions in the intermediate t a region in detail. 
The existence of the gap closing points is confirmed numerically. In addition, we will find 
that for some gaps near the van Hove singularity at t a — 1 or on the lower and upper edges of 
the spectrum unexpected topological quantum phase transitions occur due to accumulation 
of gaps in a weak magnetic field. In Sec JVI[ we apply our results to graphene where t a is 
given by 1 and determine its Hall conductance. The unconventional quantization of the Hall 
conductance is obtained from our results. It is also explained naturally why it persists up to 
the van Hove singularity. In Sec JVIl we also examine the edge states of graphene in a weak 
magnetic field, in order to confirm our results using the bulk-edge correspondence. Finally, 
in Sec JVIIt we will summarize our results. 
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FIG. 1: The honeycomb lattice. Closed and open circles shows sublattice A and B, respectively. 
t a is the hopping integral of the horizontal bond. 



II. MODEL 

Let us consider the tight-binding model on the honeycomb lattice with the nearest neigh- 
bour hopping in a magnetic field. See FigHJ Denote wave functions on sublattices A and B 
as i() ntm and <p n;m , respectively, then the tight-binding model is given by 

— 0n+l,m-l — 0n+l,m+l — ^a e "^"Vn^m + £lpn,rn = Elft n>m , 

VVi— l,m+l VVi— l,m— 1 ^a*3 ^Pn,m ^0n,m E(j) nm , (9) 

where a magnetic flux through a unit hexagon is given by $, the hopping integrals of the 
horizontal bonds are t a and those for the other bonds are 1. Here we have introduced 
potentials £ on sublattice A and — £ on sublattice B to remove a subtle singularity at E — 0. 
We take £ — > in the final stage of analysis. For simplicity we neglect the spin degrees of 
freedom in the following. 

III. WEAK t a PHASE 

In this section, we study the weak coupling limit of the horizontal bond t a < 1. Using 
the perturbation theory, we derive the Diophantine equation and provide a general rule to 
determine the Hall conductances. We also find that the unconventional quantization ([T]) 
holds in a weak magnetic field. 
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A. weak t a perturbation 



-71 



71 




h/ 








-71 





FIG. 2: The first and the second Brillouin zones for $ = in the momentum space defined by (|10p . 
The primitive vectors are a\ = (1, 1) and a% = (1, —1) in the space of (n, m), so the generators of 
the reciprocal lattice are b\ = tt(1, 1) and &2 = 7r(l, — 1). 



Let us consider 
of ip niTn and cf> 



in the momentum space. By performing the Fourier transformation 



(10) 



M becomes 



h(k) 



u{k x , ky) 


- t a a + 


v(k x , k y ) 





u(k x , k y + 7r$) 
v(k x , k y + tt$) 



where /z(fc) and a± are given by 
and 



C AW(fc) 
A(°)*(fc) -f 





u(k x , ky 


7T$) 


= E 


u{k) 




v(k x , ky 


7T$) 




v(k) 


A (0) (fc) = -2e 4fe 


COS 





(12) 






H 




























1 






(13) 
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When t a = 0, (TTTT) reduces to 



u(°)(fc) 


= E 




v(°)(Jfe) 




u(°)(fe) 



/l(fe) 

then the energies are found to be 

E = ±^ + 4 cos 2 fc y (= ±£(°)(Ag), 
and the eigen vector with the positive energy, E = E^°'(k y ), is 

1 



(14) 



(15) 



«?>(fc) 
«f (fc) 



a/2_E(°)(^)(^ + E^(ky)) 



and that with the negative one, = —E^(k y ), is 

1 



«L 0, (fc) 
^ 0) (fc) 



v^W(^TW(^)) 



A(°)*(fc) 



-A(°)(fe) 

e+^ (o) (y 



(16) 



(17) 



Here the staggered potential £ removes singularities in the energies, ±E^(k y ), and the 
eigen vectors at k y = ±7r/2. It also remedies the singularity of A(k) in (I4T1) at = ±7r/2. 
To solve (TTTT) in perturbative expansions in powers of t a , it is convenient to take the basis 
(u(k), v(k)) as 



u(k) 
v(k) 



a{k) 



«<?(fc) 
«f (fe) 



tt^(fc) 
t/ 0) (fc) 



(18) 



Substituting this into (1TT1) and multiplying (it+ (fc), t>^*(fc)) to the both sides, we obtain 
(E-E^(kl + 7r^m))a m (k x ,k° y ) = 

-t a [u^*(k x , k° y + n<$>m)vf{k x , k° y + 7r$(m + 1))] a^C^, fcj) 
-t a \u^*(k x , k° y + 7r<S>m)v (0 \k x , k° y + 7r$(m + 1))1 (3 m+1 (k x , k° y ) 



-t a 
-tn 



vf\k x , k° y + 7r$m)«V° j (^, + 7r$(m - 1)) cw^fc*, fc. 



,(°) 



vf*(k x , k° y + ^m)u {0 \k x , k° y + vr$(m - 1))J (3 m -i(k x , k° y ), 
where a m (k x , k y ) and (3 m (k x ,ky) are defined as 

a m {k x , k y ) = a(k x , k° y + vr$m), p m (k x , k° y ) = p(k x , k° y + vr$m), 



(19) 



(20) 



and ky satisfies < k y < 2n/q. Here we have used the normalization conditions of the 
functions (u+\k), v+\k)) and (u_(k),v_(k)). In a similar manner, we also have 

(E + E ( - \k° y + 7T^m))i3 m (k x ,k° y ) = 



-t„ 



-t„ 



u [ T(k x , k° y + Tr$m)vy(k x , k° y + vr$(m + l))j a m+1 (k x , k° y ) 
u {0) *(k x , k° y + n$m)v (0 \k x , k° y + vr$(m + 1))] /3 m+1 (k x , k° y ) 
v^*(k x , k° y + ir<f>m)uf(k x , k° y + 7r$(m - 1))] a m ^(k x , k° y ) 
v^*(k x , k° y + ^m)u^\k x , k° y + 7r$(m - 1))1 {3 m _i(k x , k° y ). 



(21) 



When t a — 0, these equations reduce to 



(E - E^\k° y + Tr$m))a m (k x , k° y ) = 0, 
(E + E^(k° y + ir$m))/3 m (k x , k° y ) = 0, 



(22) 



and the unperturbed solutions are given by 



and 



E = E^{k° y + vr$m), a m (k x , k° y ) = 1, /3 m (k x , k° y ) = 0, 



E = -E^{k° y + 7r$m), a m (k x , k° y ) = 0, p m (k x , k° y ) 



(23) 



(24) 



which reproduce (fi~6|) and (fTTl) . respectively. In the new basis, a(k) and (3(k) describe the 
upper (E > 0) and lower (E < 0) bands, respectively. The energy spectrum for t a = is 
shown in FigJHJ 

In f[T§l) and f[2~Tl) . the terms proportional to t a give couplings between the momenta k y 
and /c^ ± 7r$. So, if we put § = p/q with co-prime integers p and q {q > 0), then in general 
gaps open when E^ \k y ) = E^°'(k') with 



A- 



v '"y 



k' + 7T ( - 1 t /c„ 



-fc' + 7TS. 



(25) 



Here s is an integer, and k y and fc^ couple by |t|th-order perturbation. The size of the gap 
is an order of t£ . If s is chosen appropriately, k y is put between and it and k y for the r-th 
gap from the bottom can be chosen as 



E<°> 




FIG. 3: The energy spectrum for t a = 0. The upper band and lower one correspond to the eigen 
state with a m = 1 and one with (3 m = 1, respectively. We show the case of £ = 0.05. 



where r is an integer with 1 < r < 2q — 1. (Gaps with 1 < r < q — 1 open in the lower 
band (E < 0), and those with q + l<r<2q — 1 open in the upper band (E > 0). A gap 
at .E = corresponds to r = g, but it closes when £ — * for a weak t a .) Eliminating fc^ and 
k' y from ff25l) and fl26l) . we have the Diophantine equation 



(27) 



where we have written the subscript r since t and s depend on r implicitly as a solution of 

(ETD- 

We can also derive the formula ([3]) in the perturbation theory. For brevity, we derive it 
only for gaps in the upper band (E > 0). The same formula can be obtained for gaps in the 
lower band (E < 0) in a similar manner. The wave function in the upper band (E > 0) is 
simply given by 



u(k X} ky) 
v(k x ,k° y ) 



Otrnikxi ky 



u^(k x , k° + 7T0m) 



u_ {k x , k^ + 7T0m) 



+ a m >(k x , ky) 



uf(k x ,k°y + vr0m') 



u ( °\k x ,k° + -K<j)m') 



(2£ 



where m — m! + t and we take < ky < ir/q. The gaps are at ky = and vr/2g. Write 
a m = a and a m i = b, then an effective Schrodinger equation is given by 



(29) 



e r]e lkxt 




a 


= E 


a 












b 




b 



where e and E are measured from the middle of the gap, namely 

E = E {0 \k y + 7T(j)m), 
9 



(30) 



and ky = for even r or 7i/2q for odd r. Here the /^-dependence of the off diagonal elements 
of the matrix in fl29|) is determined by ([161) . (fTTl) and (fT9l) . and the parameter r/ is a real 
number and of the order of ta- The solutions of (I2"§j) are 



v/2E + (E + -e) 



r/ 

(E+ - e)e 



-ik x t 



(31) 



and 



When e/|r/| 



v/2E_(E_-e) 
oo, these solutions behave as 



(E- 



e e 



ikxt 



(32) 



a + 




sgnr/ 




a_ 
















6_ 




g ikxt 



(33) 



and when e/|^| 



-oo, 
















sgnr? 






g ikxt 


> 


6_ 








(34) 



For the upper edges of r-th band, we take the solution (1321) with t = t r . The asymptotic 
behaviors ( 1331) and ( 1341) imply that as passes (for even r) or it /2q (for odd r), the wave 
function changes from 



u(k x , ky) 




= sgnr/ 


_v(k x ,k° y )_ 



u { °\k X} + 7r0m) 



u { °\k XJ + 7r0m) 



to 



u(k x , ky) 
v(K, k° y ) 



uf(^,^ + W>m') 



(35) 



(36) 



And for the lower edge of r-th band, we take the solution ([3T]) with t = t r _i, then we have 
asymptotic behaviors of the wave function in a similar manner. On the overlap in the center 
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of the band, these wave functions are related to each other by transition functions. See 
FigJH On the overlap I in FigJH the wave function fl35l) is identified with 



u(k x , ky) 




= sgn?7 

+ 


v {k x , ky) 



uf'(k x , k° + 7r0m) 



uf\k x , k° y + 7r0m) 

by a trivial transition function, e = 1, and on the overlap II, f[3T)j) is identified with 



(37) 



u(k x , ky) 

V(k x ,k y) 

by the transition function 



uf{k x X + ^m') 



D ihx (tr tr— l) 



(38) 



(39) 




FIG. 4: An upper edge U u and a lower one Uj of a band. They overlaps in the regions I and II. 



Now let us calculate the contribution of the r-th band to the Hall conductance, 

= J J dk x dk° y (V k x A(k)) z . (40) 

Here the integration of fflOt) is performed on the first magnetic Brillouin zone, and A(k) is 
defined as 

A(k) = -i[u*(k)V k u(k) + v*(k)V k v(k)}, (41) 

where (u(k), v(k)) is the wave function for the r-th band constructed above. For the present 
purpose, it is convenient to consider the rectangle region given by — tt < k x < -k and 
< ky < 2n/q, which is equivalent to a pair of the first magnetic Brillouin zone. Performing 
the integral (j4l3l) in this region and dividing it by 2, we have 

4? = -J-t[_ dk * dk v( V k x ( 42 ) 
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From the Stokes theorem, one can show that only the transition function (|39|) in the center 
of the band contributes to this integral. Thus we obtain 



(The factor 2 arises because we have the transition function (1391) twice in the integral region 
of (1421) .) When the Fermi surface is in the r-th gap from the bottom, we have the formula 



B. Hall conductance and the Diophantine equation 

Let us now determine the Hall conductance. As we showed above, the Hall conductance 
in units of —e 2 /h, namely t r , satisfies the Diophantine equation. By combining with the 
perturbation theory, the Diophantine equation enables us to determine the Hall conductance 
algebraically. 

Before giving a rule to determine the Hall conductance, we briefly summarize properties 
of the Diophantine equation which we shall use later. First, the Diophantine equation has an 
infinite number of solutions: If we have a solution (s r , t r ) for a given r, then (s r — Ip, t r + Iq) 
for any integer / is also a solution. Second, the minimal value of \t r \ among the solutions 
satisfies \t r \ < q/2. We denote a solution with the minimal \t r \ by (s°,t°). Third, except 
when q is an even integer and \t r \ = q/2, (s°, t°) is uniquely determined. When \t r \ = q/2, 
we have two solutions: t° = ±g/2. 

As we denoted in Sec JIII A| \t r \ is an order of the perturbation. So one naively expect 
that the size of the rth gap from the bottom and its Hall conductance are given by its 
minimal value But this is not always correct. The reason why is that if an intermediate 
state in the |t°|th order perturbation has the momentum k with A^fc) = 0, (namely k 
with k y = 7r/2 (mod 7r), then the transition amplitude becomes zero. For example, let us 
consider a gap at k y = (r /2q)n with r = q + 4p. (We assume that q ^> p.) In this case, 
the minimal value of \t r \ is given by t r = 4, so a naive expectation is that the gap opens in 
fourth order perturbation. In Figj5l we illustrate intermediate states. As is seen there, we 
have to pass through either a m _2 or (3 m -2 a s an intermediate state, and both of them have 




(43) 




(44) 



r'=l 
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FIG. 5: Intermediate states for a gap at k y = (r/2q)-K with r = q + 4p in fourth order perturbation. 
The states a m and a m '= m -4 represented by solid circles are mixed by the perturbation. Open 
circles represent intermediate states. 



k y = 7r/2. From ( fl~9l) and ( |2T|) . the transition amplitude to the intermediate state a m _2 is 
proportional to 

v+\k x , k° y + 7r$(m - 2)) oc A<°>(k, |), (45) 

and that from /5 m _ 2 is proportional to 

u (0) *(k x , k° y + vr$(m - 2)) oc A^(k x , |), (46) 

and both of them are zero since A^°\k) = at k y = tc/2. So the matrix element between 
a m and a m _ 4 vanishes. As a result, no gap opens in the fourth order perturbation. The gap 
opens in a higher order perturbation. 

Now let us derive a condition that the transition amplitude in |t°|th order perturbation 
vanishes. Without losing generality we can assume that t° r ^ since t° becomes zero only 
for a gap at E = 0, which closes when £ — > 0. We also assume that 7^ q/2. The case of 
|t°| = q/2 is discussed later. Consider the mixing between k y and k' y with 

*ir=Qj)*. *y = *4 + *(jj)£ k y = ~K + ™r- ( 47 ) 
There are — 1 intermediate states, and since k x and k' x are given by 

K — + 2 (j^j Mi = 2 S ° ~~ 2" (g) 
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they have momenta 

k" - 

where 



1,2,...,*-!, forOO, 
-1,-2,- •• ,t° + l, fort°<0. 

If ky in (|49p becomes 7r/2 (mod tt), then the transition amplitude in the |i°|th order pertur- 
bation vanishes. In order for ky to be 7r/2 (mod 7r), 



(*? - 2/) (51) 



p 

must be an integer at least. And to satisfy this i° — 21 is needed to be a multiple of g since 
p and g are co-prime integers. But because t® satisfies 

\t° r -2l\ < \t r \ < |, (52) 

this is possible only when t° — 2Z = 0. Thus i° must be even. Furthermore, s° must be odd 
in order for ky to be 7r/2 (mod 7r) since ky = (tt/2)s® when £° = 2/. Therefore only when 
t° is an even integer and s° an odd one, the transition amplitude vanishes. Otherwise, we 
have a nonzero transition amplitude in the |t°|th order perturbation in general. 

When t° r is an even integer and s° r an odd one, a nonzero transition amplitude is obtained 
in the next leading order. The next minimum value of \t r \ is given by 



t° r - q, for t° r > 0, 
t° r + q, for t° r < 0. 

The intermediate states in this order have momenta 



(53) 



with s r = s° + p (s r = s° - p) for t° > (t° < 0) and 

-1,-2,- •• ,t°-g + l, fort°>0, 
1,2,- •• ,t° + g-l, fort°<0. 



(55) 
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This ky can not be 7r/2 (mod 7r): In order for ky to be n/2 (mod 7r), £°/2 — / must be a 



multiple of q, but this can not be met from the restriction < \t° r /2 — l\ < q. 

Now we summarize a procedure to determine the Hall conductance for the rth gap from 
below under a magnetic field $ = p/q. 

1. First, find a solution of the Diophantine equation, (s°,t°), which satisfies \t®\ < q/2. 

2. Then if t® is an even integer and s° an odd one, the Hall conductance is given by 



and the size of the gap is an order of 4 ■ 

Finally, let us discuss the case of \t°\ = q/2. This is possible only when q is even and 
only for gaps with r = q/2 or r = 3q/2. Although we have two solutions of the Diophantine 
equation, t® = ±<?/2, the Hall conductance is determined uniquely if q/2 is an even integer. 
Since p is odd when q is even, it can be shown that one of these solutions has an odd s° 
and the other has an even S®. So from the argument above, it is found that if q/2 is an 
even number, the solution with an odd s° has vanishing transition amplitude in the (g/2)-th 
perturbation. Thus the Hall conductance is given by the solution with an even s°. 

When q/2 is an odd number, both of the solutions with t° = ±g/2 have non zero transition 
amplitudes. For q = 2, the gap closes since the transition amplitudes of these solutions are 
the same up to a phase and cancel each other at some k x , but for the other case, (namely 
q = 2(2n + 1) with integers n), a gap opens and the Hall conductance is given by t° r with a 
larger amplitude, which can not be determined algebraically. 

C. gap structure and unconventional Hall conductance in a weak magnetic field 




(56) 



The size of the gap is an order t a 




(57) 



Let us now examine the Hall conductance for the weak t a case in a weak magnetic field. 
Consider the r(= qs r + pt r )th gap from the bottom. Since r satisfies < r < 2q, t r is 
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restricted to 

- Q s r < t r < (2 - s r ) Q . (58) 

So if s r > 3 or s r < — 1, |t r | is bounded from below by (q/p)- In these cases, the size of the 
gap 0(ta"') becomes zero in a weak magnetic field limit, (p/q) — > 0. Therefore, visible gaps 
in a weak magnetic field are possible only for the following three classes of r, (a) r = pt r , 
(t r = 1, 2, • • • , ), (b) r = 2g+pt r (t r = -1, -2, • • • , ), and (c) r = g+pt r (t r = ±1, ±2, • • • , ). 

In the case of (a), we have (s°, i°) = (0, n) if we put t r — n with < ra < q/2. Since s° is 
even, the Hall conductance for r = pnth gap from below is given by 

e 2 

<7xv = —^n, (n = l,2,---). (59) 

Thus the conventional quantization holds in this case. These gaps are near the bottom of 
the spectrum. In a similar manner, it can be shown that gaps in the class (b) also show the 
conventional quantization for the Hall conductance. Namely the Hall conductance for the 
gap with r = 2q — pn' (0 < n' < q/2) is given by 

e 2 

v xy = jn', (n' = 1,2,- ■■ ,). (60) 

These gaps are seen near the top of the spectrum. 

For visible gaps in the class (c), we have the unconventional Hall conductance. If we put 
t r = n" with \n"\ < q/2, we have an odd s£. ((s°,t°) = (l,n").) Thus we have a visible gap 
only if n" is an odd number, n" = 2m + 1 (m is an integer). Otherwise, the lowest order 
perturbation is an order of q, then the corresponding gap is invisible in a weak magnetic 
field limit. For this class of visible gaps with r = q + p(2m + 1) and \2m + 1| < q/2, we have 
the unconventional quantization for the Hall conductance 

e 2 

o xy = -j@rn + 1), (m = 0, ±1, ±2, • • • , ). (61) 
These gaps are located around E — 0. 

IV. STRONG t a PHASE 

Now let us consider the strong coupling limit, t a » 1. In this limit, the upper (E > 0) 
and the lower (E < 0) parts of the spectrum separate from each other, and both of them 
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<|> V n'+l,m'+l 




FIG. 6: The square lattice appearing in the strong t a limit of the honeycomb lattice in FigHJ Here 
n' = (n + m)/2 and m! = (m — n)/2. 



are equivalent to that of the square lattice shown in Figj6l To see this, consider first the 



case of $ = 0. When $ = 0, ffTTT) becomes 



(h(k) - t a a x 

In the leading order of the strong coupling limit, this equation reduces to 



u(k) 


= E 


u{k) 


v{k) 




v(k) 





u{k) 


= E 


u(k) 




v{k) 




v(k) 



thus we have two flat bands 



and 



1 

71 



i 

71 



E = t a , 



E= -t n 



(62) 



(63) 



(64) 



(65) 



In order to discuss the next leading order, it is convenient to take the following basis, 



u{k) 
v(k) 



a(fc) 71 



1 




1 


-1 




1 



(66) 
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In this basis, (1621) is rewritten as 

£J(fc) + A<°)( fc )-A.o).( fe ) 6(fc) _ A'°'W +2 A'°'-W a(fc) + Mfc) = £a(fc) 

+ A.°)( fe )+A«°).( fc ) t(fc) _ A<°'W-A<°>-W aW _ = B6(fc)i (67) 

and we can neglect the mixing terms between the upper band and lower one in the next 
leading order. Therefore, we have 

- A(0) ( fc )+ A(0) *( fc ) a ( fc) + taa(fc) = Ea ( k ^ 

A(°)(fc) + A(°)(fc) b(fc) _ = ^ (fc) _ (6g) 

The eigen energies of these equations are E = ±(t a + 2 cosk x cos By changing variables 
as fc^ = k x + k y and k 2 = k y — k x , they reduce to the energies of a pair of the tight binding 
models on the square lattice up to the constant shifts ±t a , 

E = ±(t a + cosk[ + cosk 2 ). (69) 

Now consider the case of $ = p/ q. For this purpose, we take a new gauge for the magnetic 
field and consider the following equations, 

6 ^ 0n+l,m— 1 0n+l,m+l ^a0n,m "I - £,1pn,m Elp n ^ m , 
-e~ i7r * (n+m Vn-l,m+l - ^n-l.m-1 ~ *a^n,m - £0n,m = (70) 

In terms of a(k) and these equations are rewritten as 

p—ik' 2 pik'2 



(b(k[ - 27r$, fc£) - a{k[ - 2tt$, 4)) + — (b{k[ + 27r$, k' 2 ) + a(k[ + 2tt<I>, k' 2 )) 



^ —I—A/ \ X 3 ' 2 

+ cos k[a(k') - i sin k[b(k') + t a a(k') + £b(k') = Ea(k') 

^ /-./-./ ^ T 1 / \ /I/ „ T 1 / \ \ C- 



(6(ifei - 27r$, fc£) - a(Jfei - 2vr$, 4)) - — (&(JfeJ + 27r$, fc£) + a(k[ + 2vr$, fc£)) 



2 v \ x — j z/ \ 1 — j z// 2 
- cos k[b(k') + i sin ^a(fc') - t a b{k') + fa(fc') = Eb{k'), (71) 

where (k[, k' 2 ) are momentum conjugate to the coordinate (n',m'), which are given by k[ = 
k x + k y and k! 2 = k y — k x . In the leading order, we have again the two flat bands, 

t a a(k') = Ea{k'), -t a b{k') = Eb(k'), (72) 



18 



and in the next leading order, the mixing terms between the upper band (E = t a ) and lower 
one (E = —t a ) can be neglected as 

ik' —k' 

e -^-a{k\ + 2vr$, k' 2 ) + ^-a(k[ - 2tt$, k' 2 ) + cos ha(k') = (E - t a )a(k'), 

ik 1 —ik 1 
g«v 2 g " t 2 



b(k[ + 2vr$, k' 2 ) b(k[ - 2tt<S>, k' 2 ) - cosk[b(k') = (E + t a )b(k'). (73) 

z, 2 

These equations coincide with that of the tight-binding model on the square lattice illustrated 
in Figj6] except for the constant shift in the energies. 
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221 ]. we can 



Using the results of the tight binding models on the square lattice in 
determine the Hall conductance for r-th gap in the strong t a limit as 

°*y = ~jt° r , (74) 

where t° r is a solution of the Diophantine equation with < q/2. For r = q/2 and 
r = 3q/2, we can not determine the Hall conductance algebraically since we have two 
solutions £° = ±q/2. The corresponding gaps in the strong coupling limit close, but for a 
strong but finite t a they open from a mixing between the upper band and the lower one. 
The Hall conductance is given by one of the two possible values of t a (= ±g/2), but there is 
no algebraic rule to determine it. 

Let us comment briefly the Hall conductance for the strong t a case in a weak magnetic 
field. As was shown before, only three classes of gaps are visible in a weak magnetic field: 

(a) r = pt r , (t r = 1, 2, • • • , ), (b) r = 2q + pt r , (t r = -1, -2, • • • , ), (c) r = q + pt r , 
(t r = ±1, ±2, • ■ ■ , ). For these classes of gaps, we have (a) (s°,i°) = (0, n) (0 < n < q/2), 

(b) (s° r ,t° r ) = (2,-n 1 ) (0 < ri < q/2) and (c) (s° r ,t° r ) = (l,n") (\n"\ < q/2), respectively. In 
contrast to the weak t a case, the formula (|74p indicates that all of them show the conven- 
tionally quantized Hall conductance. 



V. PHASE TRANSITIONS IN INTERMEDIATE t a REGION 
A. topological quantum phase transitions 

In the above we have calculated the Hall conductance in two opposite limits, t a — > and 
t a — > oo. The algebraic rules to determine the Hall conductances in the both limits were 
given and it was found that for gaps with even t° and odd s° the Hall conductances take 
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different values from each other. It implies that each gap in this class closes at some t a at 
least once in order to change the corresponding topological number t r . In other words, we 
should have a quantum phase transition between topological insulator phases at some t a if 
the Fermi energy is located in a gap in this class. 

In the following, we will confirm the existence of the quantum phase transition numer- 
ically. In addition, we will find that an unexpected topological quantum phase transition 
occurs due to the van Hove singularity. 

B. numerical studies of quantum phase transitions 

Here, we will study the whole region of t a for a number of cases of $ = p/q by using 
numerical calculations. We will find that except for a few gaps either the strong t a limit or 
the weak t a one explains the gap structures qualitatively and the Hall conductance quanti- 
tatively: For a weak t a region, < t a < 1, the gap structures are the same as those in the 
weak t a limit, and for a strong t a region, t a > 2, they are the same as those in the strong 
t a limit. In the intermediate region, 1 < t a < 2, we have the topological quantum phase 
transitions mentioned in the previous subsection and the gap structure changes from those 
in the weak t a region to those in the strong one. From the topological nature of the Hall 
conductance, these results imply that except for a few gaps the Hall conductances in the 
whole t a region are determined algebraically by using either those in the weak t a region or 
those in the strong one. 

It will be shown that the exceptional gaps appear just beyond the van Hove singularity at 
t a = 1 (namely the van Hove singularity in graphene) or on the lower and the upper edges 
of the spectrum. For some gaps in these regions, additional topological quantum phase 
transitions, which are unexpected from the analysis in the two limits, are observed. It will 
be found that multiple topological quantum phase transitions occur for these gaps. 

In the following we limit our calculation to0<$<l/2 without losing generality: This 
is because the spectrum is invariant under translation $ — > $ + n with an integer n, and 
reflection about half integer values of $. Furthermore a close inspection of the model also 
shows that the spectrum is unchanged under reflection E «-> —E for a given $ = p/q. 

We illustrate typical examples of energy spectra in FigsJTlfTB"! For $ = 1/2, 1/3 and 1/4, 
as is shown in FigJTl none of the gaps closes in a finite region of t a , and a gap opens at 



20 



E = when t a > 1. Since the Hall conductances for the unclosed gaps remain the same 
values when t a changes, they can be calculated algebraically by using the results of the weak 
t a limit or those of the strong one. The Hall conductances determined in this manner are 
also shown in FigJTl For some gaps, both the weak and strong t a analyses can be used to 
determine the Hall conductances and they are found to give consistently the same values. 

For $ = 1/5 and 2/5, there are gap closing points in the energy spectra at t a ~ 2. See 
Figs|8]and[9j It is found that for the gaps with the gap closing points, the Hall conductances 
obtained in the weak t a analysis are different from those in the strong one. This means that 
the gap closing points are required by the topological quantum phase transition described in 
Sec JV Al In FigsJH] and M we also illustrate intermediate states in the weak t a perturbation. 
One can see that for the gaps with the gap closing points, there exists the intermediate state 
with k y = ±7r/2 (mod. rr). For the other gaps we have no intermediate states with the these 
momenta. Similar gap closing points are also found for $ = 1/6, 1/7, 2/7 and 3/7 in FigflOl 
These gap closing points are also required by the topological quantum phase transition. It 
is shown in FigJTOl how t r of the Hall conductance a xy = —(e 2 /h)t r changes from the weak 
t a region to the strong one. 

When q is large (q > 7), a new kind of gap closing points, which are not required by the 
topological difference between the weak and strong t a limits, appears for some exceptional 
gaps. For example, see Fig. [12j We have two gap closing points in the same gap where 
the quantum Hall conductance in the weak t a limit is the same as that in the strong t a 
limit. There is no a prior topological reason why the gap should close in the intermediate 
t a . The possible origin of the additional gap closing points is accumulation of gaps at these 
singularities. For a large q, many magnetic bands are accumulated both near the van Hove 
singularity at t a — 1 and on the lower and upper edges of the spectrum, so the gaps near 
the singularities become narrow and are easy to close as the accumulation grows. Except 
near the singularities, we did not observe the additional gap closing points 

To illustrate the weak magnetic field case, $ < 1, we also show the energy spectra for 
1/25, 1/40 and 1/50 in FigsHIJ [T2landfT3l The Hall conductances for visible gaps are also 
shown in these figures. It is found that in the weak t a region including the graphene case 
(t a = 1) the Hall conductances are unconventionally quantized as a xy = e 2 (2n + l)/h, (n = 
0, ±1, ±2, ■ • • ) near half-filling (E = 0), while in the strong t a region they are conventionally 
quantized as a xy = e 2 n/h, {n = 0, ±1, ±2, • ■ • ). 
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*=7/2 




FIG. 7: The energy spectra v.s t a for <J? = 1/2, 1/3, and 1/4. None of gaps closes as we make t a 
stronger. The Hall conductance a xy = —(e 2 /h)t r for r-th gap from the bottom, which is calculated 
algebraically by the method described in the text, is also shown. 



VI. GRAPHENE CASE (t a = 1) 
A. Hall conductance 



Let us now apply our results to graphene, where t a is given by 1, and determine its Hall 
conductances. As was shown in SecJVBj the numerical studies strongly suggest that for 
most energy regions graphene (t a = 1) is in the weak t a phase: Except the energy regions 
just beyond the van Hove singularities at E = ±1 (namely, the energy regions where \E\ is 
slightly greater than 1) or those on the lower and upper edges of the spectrum none of gaps 
closes as we change t a from to 1, and the structure of the energy spectrum is qualitatively 
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FIG. 8: a) The energy spectrum for <E> = 1/5. b) A closer look at the gap closing point in the seventh 
gap from the bottom, c) The unperturbed states and the mixing in the weak t a perturbation for 
<I> = 1/5. The states with the same symbol are related to each other in the perturbation. The solid 
arrows indicate the mixing between states. The dotted arrow indicates the mixing with vanishing 
amplitude, which has an intermediate state with the singular momentum k y = n/2. Integers denote 
t r for the mixing. 

the same as that in the weak t a limit. In particular, if we consider the r-th gap from the 
bottom, only the gaps with the following three classes of r are visible in a weak magnetic 
field: (a) r = pt, n (t r = 1, 2, • • • , ), (b) r = 2q + pt r , (t r = -1, -2, • • • , ) (c) r = q + pt r , 
(* r = ±l,±3,±5,... ,). 

These results indicates that even when t a — 1 the perturbation theory works well at 
least qualitatively for gaps away from the exceptional energy regions. From the topological 
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1.2 1.6 2 2.4 




FIG. 9: a) The energy spectrum v.s t a for $ = 2/5. b) A closer look at the gap closing point in the 
ninth gap from the bottom, c) The unperturbed states and the mixing in the weak t a perturbation 
for $ = 2/5. 



nature of the Hall conductance, it implies that the Hall conductances in graphene for these 
gaps are quantitatively the same as those at the weak t a limit. Namely they are determined 
algebraically by the rule (155]) and (157)) . In addition to the visible gaps in a weak magnetic 
field, this rule also determines the Hall conductances for the subband gaps in a strong 
magnetic field. 

This result consistently explains the unconventional quantization of the Hall conductance 
observed experimentally near half filling [l, 2]. Among the visible gaps in a weak magnetic 
field, only those in the class (c) include the gaps near half filling (E = 0). They show the 
unconventional quantization of the Hall conductance, a xy = —e 2 t r /h (t r = ±1, ±3, • ■ • , ). 

We emphasize here that our result indicates the unconventional Hall conductance persists 
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FIG. 10: The energy spectra v.s t a for $ = 1/6, 1/7, 2/7 and 3/7. The gap closing points appear 
whenever the Hall conductance (a xy = —{e 2 /h)t r ) in the weak t a region is different from that in 
the strong t a region. 



up to the van Hove singularities, where the Dirac fermion description is no longer valid. This 
is because none of gaps in this energy region closes when we change t a from to 1. They 
are well described by the weak t a analysis and the Hall conductance for the visible gaps 
in a weak magnetic field shows the unconventional quantization. (Note that they belongs 
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FIG. 11: a) The energy spectrum v.s t a for (j) = 1/25. Integers in the gaps indicates t r of the 



Hall conductance a 



■HI 



(e 2 /h)t r - b) A closer look at gap closing points near t a = 1. It is found 



that gap closing points appear only when t a > 1. The gap with t r 
shown) . 



-15 closes at t a ~ 1.25 (not 



to the class (c) above.) This anomalous behavior of the Hall conductance on honeycomb 

n 

lattice was already reported in a numerical calculation [8J, but our study here establishes 
this analytically. Furthermore, at the same time, it reveals why the unconventional Hall 
conductance does not persist beyond the van Hove singularities: For gaps just beyond the 
van Hove singularities, a gap closing point can appear when t a changes from to 1. So 
in general the weak t a analysis does not apply to the gaps in this region and there is no 
reason why the unconventional Hall conductances hold. The unconventional quantization of 
the Hall conductance up the the van Hove singularities should be observed if the chemical 
potential can be varied over a wide range in graphene. 
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FIG. 12: a) The energy spectrum v.s t a for (j) = 1/40. b) A closer look at gap closing points near 
t a = 1- Integers in the gaps indicate t r of the Hall conductance a xy = —(e 2 /h)t r . For the gap 
with t° r = 11, we have two gap closing points which are not required by the topological difference 
between the weak and strong t a limits. 



B. edge states 



To confirm the results in the previous section, we compare here the bulk quantum Hall 
conductance obtained by the rule fl56|) and (}57]) and the number of edge states obtained 
numerically for finite systems with t a — 1. From the bulk-edge correspondence in quantum 
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261 ] . these quantum numbers should coincide with each other for 



gaps with no gap closing point in the region < t a < 1. In other words, the results in the 
previous section suggest that they should be the same except for some gaps just beyond the 
van Hove singularities or those on the upper and lower edges in the spectrum. 

To calculate the number of edge states, we consider cylindrical systems with bearded 
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FIG. 13: The energy spectrum v.s. t a for <j) = 1/50. Integers indicate t r of the Hall conductance 
o xy = -(e 2 /h)t r . 

edges at both ends. For all possible $ = p/q (0 < $ < 1/2) with 1 < q < 11, the energy 
spectra of these systems are obtained numerically and the numbers of the edge states are 
evaluated. We also examine the case of $ = 1/25 as a weak magnetic field case. 

In FigfT4l we illustrate the energy spectra for 5 < q < 7. Except for gaps near the 
singularities mentioned above, we have excellent agreements between the number of the edge 
states and the bulk Hall conductance determined by the rule (1561) and (E7j). In particular, 
even for the subband gaps, which become invisible in a weak magnetic field, these two 
quantum numbers are found to agree with each other. This results clearly indicate that 
except for gaps near the singularities, the Hall conductances in graphene including those 
for subband gaps are determined by the rule ( |56|) and ( IBTl) . In addition, for some gaps 
located just beyond the van Hove singularity at E — 1 or those on the lower and upper 
edges of the spectra, we find a disagreement between them, which is also consistent with the 
analyses presented in the previous section. We also checked that the similar results hold for 
all $ = p/q with q < 11. We summarize the results for the bulk Hall conductance and the 
edge Hall conductance in Tables fl] and [Til 

To illustrate a weak magnetic field case, the energy spectrum with bearded edges for 
$ = 1/25 is also shown in Figfl5l In a weak magnetic field, subband gaps are very tiny so 
only the edge states for visible gaps are shown in the figure. The unconventional quantization 
for the edge quantum Hall conductance is found to persist up the van Hove singularities at 
E = ±1. We also find that for gaps beyond the van Hove singularities the conventional 
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d) $ = 1/7 e) $ = 2/7 f) $ = 3/7 



r 


( s r; ^r) 


_weak 


edge 




r 


( s r, ^r) 


_weak 
°xy 


edge 
<->xy 




r 


( s r, ^r) 


_weak 
°xy 


edge 
(Jxy 


1 


(0,1) 


l 


1 




1 


(1,-3) 


-3 


-3 




1 


(1,-2) 


5 


5 


2 


(0,2) 


2 


2 




2 


(0,1) 


1 


1 




2 


(-1,3) 


3 


3 


3 


(0,3) 


3 


3 




3 


(1,-2) 


5 


5 




3 


(0,1) 


1 


1 


4 


(1,-3) 


-3 


4 




4 


(0,2) 


2 


2 




4 


(1,-1) 


-1 


-1 


5 


(1,-2) 


5 


5 




5 


(1,-1) 


-1 


-1 




5 


(2,-3) 


-3 


-3 


6 


(1,-1) 


1 


1 




6 


(0,3) 


3 


3 




6 


(0,2) 


2 


2 



TABLE I: The bulk Hall conductance cr™ ak (in units of ~{e 2 /h)) of r-th gap fr om the bottom 
determined by ([56]) and ([57|) . and the corresponding edge Hall conductance <Jxy ge determined by 
counting the edge states for a) $ = 1/5, b) $ = 2/5, c) $ = 1/6, d) $ = 1/7, e) <3? = 2/7 and f) 
<3? = 3/7. The edge states are counted for t a = 1. We also show the solution of the Diophantine 
equation (s^.,t^) satisfying \t®.\ < q/2. Here we have shown o\^ ak and a X y ge for gaps in the lower 
band {E < 0) since those for the (2q — r)th gap in the upper band are the same as those for rth 
gap in the lower band with opposite signs. 

quantization for the edge quantum Hall conductance holds. The latter result suggests that 
the rule (I56p and f)57p is no longer valid for some visible gaps located just beyond the van 
Have singularities. These results are also consistent with those in the previous section. 
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TABLE II: A list of gaps where a% y ge disagrees with cr^ eak (q < 11) . The edge states are counted 
for t a = 1. For $ = 4/9 and <I> = 5/11, the gaps are located on the lower and upper edges of the 
spectra, and for the other cases, they are located just beyond the van Hove singularity. All of them 
are located at \E\ > 1. 

VII. CONCLUSION 

In this paper, we examined quantum phase structures of a tight-binding model on the 
honeycomb lattice, which are controlled by the hopping parameter t a . In contrast to the 
square lattice, where no phase transition occurs by changing the ratio of hopping parameters 
t x /t y , it was found that phase transitions occur as we change t a . In terms of the Diophan- 
tine equation, we characterized the weak t a phase and the strong t a one, respectively, and 
determined the Hall conductances for both cases. We found that the weak t a phase shows 
the unconventional quantization of the Hall conductance in a weak magnetic field although 
the strong t a phase shows only the conventional one. This implies the existence of quantum 
phase transitions accompanying gap closing points in the intermediate t a region, which was 
confirmed by numerical calculations. We also found numerically that unexpected quantum 
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phase transitions occur for some gaps just beyond the van Hove singularities at t a — 1 or 
those on the upper and lower edges of the spectrum. 

Using these results, we analyzed in detail the Hall conductance in graphene (t a = 1). 
Except for some gaps just beyond the van Hove singularities or on the edges of the spectrum, 
the Hall conductances including those for the subband gaps were determined. They naturally 
explain the experimentally observed unconventional quantization of the quantum Hall effect 
in a weak magnetic field. They also predict that the unconventional quantization persists up 
to the van Hove singularity. We also examined the edge states in graphene and confirmed 
the bulk-edge correspondence in quantum Hall effect. 
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<D=2/5 




FIG. 14: The energy spectra of graphene (honeycomb lattice with t a = 1) with bearded edges for 
a) $ = 1/5, b) $ = 2/5, c) $ = 1/6, d) $ = 1/7, e) $ = 2/7 and d) $ = 3/7. Here fc„ denotes the 
momentum along the edges. Edge states are seen in the energy gaps in the spectra. The arrows 
in d) indicate gaps where the number of edge states disagrees with the Hall conductance obtained 
by (f5B"j) and (fSTj) . Except these gaps, we have agreements between the numbers of edge states and 
the bulk Hall conductances determined by (|56p and ([5T 
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<$>=l/25 
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FIG. 15: The energy spectrum of graphene with bearded edges for <& = 1/25. Here k y is the 
momentum along the edges. By counting edge states, we have u^ ge = —{e 2 /h)(2n + 1) with 
n = —2, —1,0, 1 near E = 0. For the other regions, we have the conventional quantization of the 
Hall conductance. 
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